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IMAGE NOISE REDUCTION 
Background of the Invention 

[0001] 

Field of the Invention 

5 The present invention relates to an image processing apparatus for 

executing a noise reduction process to images, and to a method for reducing 
noise in images. 

[0002] 

Description of the Related Art 

10 In digital style cameras and the like which produce digital images using 

photoelectric transducers such as CCDs, it is known that noise tends to be 
produced in images which are obtained, as a result of the CCD properties, 
when the ISO sensitivity is increased under dark photographing conditions of 
dark photographed objects. Noise produced in portions of images 

15 corresponding to space and skin, which require smooth gray scale, significantly 
lowers evaluation of images. A number of conventional noise reduction 
techniques have thus been proposed and put to practical use. An example of a 
widely used method is to smooth images by using a moving average filter to 
smooth the image gray scale. 

20 [0003] However, images often contain contours (edge components), and the 
use of averaging filters while disregarding edge components results in the 
problem of blurred and indistinct contours. To solve this problem, smoothing 
processes which avoid contours have been proposed, but as a result of the 
moving average filter characteristics, the appropriate use of a smoothing 

25 process in areas with unexpected contours can still affect the contours, making 
it impossible to execute a satisfactory smoothing process that does not affect 
contours. 
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[0004] Meanwhile, median filters are capable of executing a smoothing 
process without compromising edges, but the computing process is extremely 
time-consuming, making this an impractical alternative. There is thus a need for 
a smoothing process that would involve lower computer processing demands 
5 and that would be capable of reducing the noise produced in images without 
causing the contours in images to become blurred and indistinct. 

[0005] 

Summary of the Invention 

To address this, an object of the invention is to bring about natural, 
10 smooth color reproduction by rapidly reducing or eliminating noise in images 
without compromising the contours in images. 

[0006] To address these issues, a first aspect of the invention provides a 
method for executing a nose reduction process in digital images. The method 
in the first aspect of the invention comprises detecting the edges contained in 
15 an image, determining the orientation that is the direction in which the detected 
edges are formed, and applying a smoothing filter to the detected edges, 
wherein the smoothing filter has an extraction area in the same direction as the 
determined edge orientation. 

[0007] According to the method in the first aspect of the invention, a 
20 smoothing filter with an extraction area in the same direction as the orientation 
of the edges is applied to the detected edges to execute the smoothing process, 
thereby bringing about natural, smooth color reproduction by rapidly reducing or 
eliminating noise produced on images (smoothing process) without 
compromising the contours in the image. 

25 [0008] The smoothing filter in the method of the first aspect in the invention 
may have an extraction area which is wider in the direction parallel to the 
orientation of an edge than in the direction perpendicular to the orientation of 
the edge. The use of a smoothing filter with such an extraction area (reference 
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area) enables a smoothing process in which less time is needed to compute the 
smoothing filter, without compromising the edges. 

[0009] The smoothing filter in the method of the first aspect in the invention 
may be a median filter. This will enable a smoothing process in which the edge- 
5 forming pixels are preserved in keeping with the above smoothing filter 
orientation properties. 

[0010] The first aspect of the invention may also be embodied as an image 
processing apparatus for executing a noise reduction process to digital images. 
The image processing apparatus pertaining to the first aspect of the invention 
10 comprises edge detection logic for detecting edges contained in images, edge 
angle determination logic for determining the orientation of detected edges, and 
smoothing logic for applying a smoothing filter with an extraction area in the 
same direction as the determined orientation of detected edges. 

[00111 The apparatus pertaining to the first aspect of the invention has the 
15 same functions and effects as the method in the first aspect of the invention, 
and can be worked in a variety of aspects in the same manner as the method in 
the first aspect of the invention. 

[0012] The first aspect of the invention may also be embodied as a computer 
readable medium that stores a program for executing a noise reduction process 

20 to digital images. The program stored on the computer readable medium 
pertaining to the first aspect of the invention is executed on a computer to 
implement a function for detecting edges contained in images, a function for 
determining the orientation of detected edges, and a function for applying a 
smoothing filter to the detected edge, wherein the smoothing filter has an 

25 extraction area in the same direction as the determined orientation of detected 
edges. 

[0013] The computer readable medium pertaining to the first aspect of the 
invention has the same functions and effects as the method in the first aspect of 
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the invention, and can be worked in a variety of aspects in the same manner as 
the method in the first aspect of the invention. 

[0014] A second aspect of the invention provides a method for executing a 
noise reduction process to images composed of a plurality of pixels. The 
5 method in the second aspect of the invention comprises finding the edge level 
in target pixels that are the object of the smoothing process, determining the 
edge angle that is the angle of an array of edge-forming pixels including the 
target pixels based on the calculated edge level, obtaining a filter that has 
orientation properties extracting pixels in a given direction as reference pixels 
10 and matching the determined edge angle; and executing a first smoothing 
process on the target pixels using the filter that has been obtained. 

[0015] According to the method in the second aspect of the invention, filters 
with orientation properties extracted using pixels in a given direction as 
reference pixels are employed to execute the smoothing process on the target 
15 pixels, thereby bringing about natural, smooth color reproduction by rapidly 
. reducing or eliminating noise produced on images without compromising the 
contours in the image. 

[0016] The second aspect of the invention may also be embodied as an 
image processing apparatus for executing a noise reduction process to digital 

20 images. The image processing apparatus pertaining to the second aspect of 
the invention comprises edge detection logic for detecting edges contained in 
the images, edge angle determination logic for determining the orientation of the 
detected edges, and smoothing logic for applying a smoothing filter to the 
detected edges, wherein the smoothing filter has an extraction area in the same 

25 direction as the determined orientation of detected edges. 

[0017] The apparatus pertaining to the second aspect of the invention has the 
same functions and effects as the method in the second aspect of the invention, 
and can be worked in a variety of aspects in the same manner as the method in 
the second aspect of the invention. 
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[0018] The second aspect of the invention may also be embodied as a 
computer readable medium that stores a program for executing a noise 
reduction process to images composed of a plurality of pixels. The program 
stored on the computer readable medium pertaining to the second aspect of the 
5 invention is executed on a computer to implement a function for calculating the 
edge level in the target pixels that are the object of the smoothing process, a 
function for determining the edge angle that is the angle of an array of edge- 
forming pixels including the target pixels based on the calculated edge level, a 
function for obtaining a filter that has orientation properties extracted using 
10 pixels in a given direction as reference pixels and has orientation properties 

matching the determined edge angle, and a function for executing a smoothing 
process on the target pixels using the filter that has been obtained. 

[0019] The computer readable medium pertaining to the second aspect of the 
invention has the same functions and effects as the method in the second 
15 aspect of the invention, and can be worked in a variety of aspects in the same 
manner as the method in the second aspect of the invention. 

[0020] A third aspect of the invention provides a method for executing a noise 
reduction process to images composed of a plurality of pixels. The method in 
the third aspect of the invention comprises finding the edge level in target pixels 

20 which are the object of the smoothing process, calculating the gradient of the 
target pixels based on the calculated edge level, obtaining a filter matching an 
edge angle on the image using the calculated gradient based on a 
predetermined relationship between the edge angles and the gradients, wherein 
the edge angle is an angle of an array of edge-forming pixels on the image, 

25 wherein the filter has orientation properties that extracts pixels oriented in the 
same angle direction as the edge angle, and executing a first smoothing 
process on the target pixels using the filter that has been obtained. 

[0021] According to the method in the third aspect of the invention, the 
gradient of target pixels is used as reference information to select a filter with 
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orientation properties extracted using as reference pixels those pixels oriented 
in the same angle direction as the edge angle, which is the angle of an array of 
edge-forming pixels on the image, and this filter is employed to execute the 
smoothing process on the target pixels, thereby bringing about natural, smooth 
5 color reproduction by rapidly reducing or eliminating noise produced on images 
without compromising the contours in the image. 

[0022] The third aspect of the invention may also be embodied as an image 
processing apparatus for executing a noise-reduction process to images 
composed of a plurality of pixels. The image processing apparatus pertaining to 

10 the third aspect of the invention comprises edge level calculating logic for 
calculating the edge level in target pixels that are the object of the smoothing 
process, gradient calculating logic for calculating the gradient of the target 
pixels based on the calculated edge level, memory logic for storing a plurality of 
filters associated with the gradient for a plurality of edge angles, wherein the 

15 each filter has orientation properties that extracts pixels oriented in the same 
angle direction as the edge angle, which is the angle of an array of edge- 
forming pixels on the image, filter selection logic for selecting a filter matching 
the edge angle on the image from the memory logic based on the calculated 
gradient, and smoothing logic for executing a smoothing process on the target 

20 pixels using the selected filter. 

[0023] The apparatus pertaining to the third aspect of the invention has the 
same functions and effects as the method in the third aspect of the invention, 
and can be worked in a variety of aspects in the same manner as the method in 
the third aspect of the invention. 

25 [0024] The third aspect of the invention may also be embodied as a computer 
readable medium that stores a program for executing a noise reduction process 
to images composed of a plurality of pixels. The program stored on the 
computer readable medium pertaining to the third aspect of the invention is 
executed on a computer to implement a function for calculating the edge level in 
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target pixels which are the object of the smoothing process, a function for 
calculating the gradient of the target pixels based on the calculated edge level, 
a function for obtaining a filter matching an edge angle on the image using the 
calculated gradient based on a predetermined relationship between the edge 
5 angles and the gradients, wherein the edge angle is an angle of an array of 
edge-forming pixels on the image, wherein the filter has orientation properties 
that extracts pixels oriented in the same angle direction as the edge angle, and 
a function for executing a smoothing process on the target pixels using the filter 
that has been obtained. 

10 [0025] The computer readable medium pertaining to the third aspect of the 
invention has the same functions and effects as the method in the third aspect 
of the invention, and can be worked in a variety of aspects in the same manner 
as the method in the third aspect of the invention. 

[00261 In the method in the second and/or third aspects of the invention, the 
15 filter may have an extraction area which is wider in the parallel direction parallel 
than in'the direction perpendicular to a given direction. The use of a smoothing 
filter with such an extraction area (reference area) enables a smoothing process 
in which less time is needed to compute the smoothing filter, without 
compromising the edges. 

20 [0027] The filter in the method of the second and/or third aspects of the 

invention may be a median filter. This will enable a smoothing process in which 
the edge-forming pixels are preserved in keeping with the above smoothing 
filter orientation properties. 

[0028] The method in the second and/or third aspects of the invention may 
25 further comprise calculating the dispersion value of the target pixels when the 
calculated edge level is lower than the prescribed edge level, and executing a 
second smoothing process on the target pixels using a moving average filter 
having extraction areas that are smaller as the calculated dispersion value 
increases. In this case, the filter size can be changed using dispersion values 
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which change according to the smoothness of the image, thereby enabling a 
noise reduction process (smoothing process) without compromising the edge 
characteristics in target pixels even if it cannot be determined whether or not 
those pixels are edge-forming pixels. 

5 [0029] The method in the second and/or third aspects of the invention may 
further comprise separating the pixel values of the image by color difference 
components and brightness components, wherein the edge level of the target 
pixels is calculated by calculating edge levels for the color difference and 
brightness components, and the edge level of the target pixels is the greatest 

10 edge level among the calculated edge levels, the dispersion value of the target 
pixels is calculated by calculating the dispersion values for the color difference 
and brightness components, and the dispersion value of the target pixels is the 
greatest dispersion value among the calculated dispersion values, and the first 
and second smoothing process are only executed on the color difference 

15 components of the target pixels. This can prevent blurring associated with 
changes in brightness, and can appropriately eliminate or reduce color noise. 

[0030] 

Brief Description of the Drawings 

Figure 1 illustrates the characteristics of the smoothing process executed 
20 on pixels forming edges by the image processing apparatus in an embodiment 
of the invention. 

Figure 2 illustrates the general structure of an image processing system 
including the image processing apparatus in an embodiment of the invention. 

Figure 3 is a flow chart of the process routine executed in the noise 
25 reduction process. 

Figure 4 illustrates an example of 3 x 3 edge detection operators used to 
determine the edge gradient g (edge level). 
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Figure 5 illustrates an example of 5 x 5 edge detection operators used to 
determine the edge gradient g (edge level). 

Figure 6 illustrates an example of an elliptical median filter with the 
orientation of the reference pixel extraction area used in this embodiment. 

5 Figure 7 shows a hypothetical illustration of the application of a median 

filter during a smoothing process on target pixels TP, showing the distribution of 
pixel values for the image in Figure 1 at the level of pixels. 

Figure 8 shows a hypothetical illustration of the application of a median 
filter during the smoothing process for the target pixel TPn1 . 

10 Figure 9 shows a hypothetical illustration of the application of a median 

filter during the smoothing process for the target pixel TPn2. 

Figure 10 shows the results of comparison a smoothing process obtained 
in the embodiment with those obtained in a conventional example. 

Figure 1 1 shows an example of a 9 x 9 moving average filter used in the 
15 embodiment. 

Figure 12 shows an example of a 17 x 17 moving average filter used in 
the embodiment. 

Figure 13 shows an example of a 21 x 21 moving average filter used in 
the embodiment. 

20 [0031] 

Description of the Preferred Embodiments 

The image processing apparatus and noise reduction process of the 
invention are illustrated in the following embodiments with reference to the 
drawings. 

25 [0032] Features of the noise reduction process executed by the image 

processing apparatus in this embodiment will be described first with reference 
to Figure 1. Figure 1 illustrates the characteristics of the smoothing process 
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executed on pixels forming edges by the image processing apparatus 
comprising several modules in an embodiment of the invention. 

[0033] In the image processing apparatus in this embodiment, it is determined, 
on the basis of edge level (gradient g), whether or note the target pixels TP 
5 which are the object of the smoothing process (noise reduction 

process/denoising process) are pixels constituting (forming) edges. If they are 
edge-forming pixels, a smoothing process is executed using the elliptical 
median filter in Figure 1 instead of a moving average filter. The median filter MP 
used in the example has an elliptical reference area RA which is tilted (angled) 
10 to match the orientation (edge angle) of an edge Eg, allowing the smoothing 
process to be executed without compromising the edges. 

[0034] Thus, in the smoothing process, the orientation (edge angle) of the 
edge Eg is determined, a median filter MP with an angle matching the 
deterrnined edge angle is selected, and the selected median filter MP is used to 
15 execute a smoothing process on the target pixel TP which is an edge-forming 
pixel. Foregoing logics are implemented by CPU 100 alone, or together with 
ROM 101, HDD 102, and RAM 103. The noise reduction process executed by 
the image processing apparatus in this embodiment is described in further detail 
below. 

20 [0035] An image processing system including the image processing 

apparatus of the embodiment is described with reference to Figure 2. Figure 2 
illustrates the general structure of an image processing system including the 
image processing apparatus in an embodiment of the invention. 

[0036] In this embodiment, the image processing apparatus is worked in the 
25 form of a personal computer PC. The personal computer PC comprises a 
central processing unit (CPU) 100 for executing various image processing 
computations including the noise reduction process, a read-only memory (ROM) 
101 for storing programs, reference tables, and the like for running the noise 
reduction process, a hard disc (HDD) 102, and a random access memory 
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(RAM) 103 for temporarily storing various types of data such as input image 
data. CPU 100 alone, or together with ROM 101, HDD 102, and RAM 103. 
constitutes a given logic. The personal computer PC also comprises an input 
interface for handling data and control signals with an external input device, and 
5 an output interface for handling data and control signals with an external output 
device. An interface logic both contact terminals (hardware) for connecting an 
external device and conversion processes (software) for signals from external 
devices. 

[0037] In this embodiment, a display device 110 and printer 20 are connected 
10 as external output devices to the personal computer PC. image data reflecting 
the results of the noise reduction process are sent in real time to the display 
device 110, displaying the output image. A print command input is triggered to 
execute the noise reduction process and send print image data converted to 
print data to the printer 20, where the output image is printed. 

15 [0038] A digital style camera 30 is connected as an imaging device to serve 
as the external input device. The digital style camera 30 is an imaging device 
which produces image data using a photoelectric transducer such as a CCD. 
Photographed images are formed through an optical lens onto a CCD. where 
the optical information (energy) is converted to electrical information (energy). It 

20 is thus known that noise tends to be produced in the resulting images of night 
sense or indoor scenes where there is not enough light. When images are 
photographed by increasing the ISO, the noise level is also known to increase. 
Image data produced by digital style cameras 30 can also be input through a 
memory card MC to a personal computer PC. 

25 [0039] This embodiment will be described with the use of a digital style 
camera 30 as the external input device in the form of an imaging device, but 
scanners, digital video cameras, and the like can also be used. Examples of 
other input devices include keyboards, mouses, and the like. 
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[0040] The noise reduction process executed by the image processing 
apparatus in this embodiment will be described with reference to Figures 3 
through 1 1 . Figure 3 is a flow chart of the process routine executed in the noise 
reduction process. Figure 4 illustrates an example of 3 x 3 edge detection 
5 operators used to determine the edge gradient g (edge level). Figure 5 

illustrates an example of 5 x 5 edge detection operators used to determine the 
edge gradient g (edge level). Figure 6 illustrates an example of an elliptical 
median filter with the orientation of the reference pixel extraction area used in 
this embodiment. Figure 7 is a hypothetical illustration of the application of a 

10 median filter during a smoothing process on target pixels TP, showing the 

distribution of pixel values for the image in Figure 1 at the level of pixels. Figure 
8 is a hypothetical illustration of the application of a median filter during the 
smoothing process for the target pixel TPn1. Figure 9 is a hypothetical 
illustration of the application of a median filter during the smoothing process for 

15 the target pixel TPn2. Figure 10 compares the results of a smoothing process 
obtained in the embodiment with those obtained in a conventional example. 
Figure 11 is an example of a 9 x 9 moving average filter used in the 
embodiment. Figure 12 is an example of a 17 x 17 moving average filter used in 
the embodiment. Figure 13 is an example of a 21 x 21 moving average filter 

20 used in the embodiment. 

[0041] The noise reduction process executed in this embodiment will be 
described with reference to Figure 3. The noise reduction process may be 
implemented in cases where, for example, based on image processing 
conditions or photographing data associated with image data, increased ISO 
25 sensitivity is indicated, the photographed scene is in the evening or at night, the 
white balance is determined by the indoor light, or the image is dark because of 
the results of image data analysis. It may also be implemented when the user 
selects the noise elimination command. A technique for writing to image data 
headers can also be implemented for the relation between image data and 

12 



PF04J501US 

image processing conditions or photographing information. The result of the 
noise reduction process may be reflected in images displayed on the display 
device 1 10 or may be reflected on the display device 110. 

[0042] When the noise reduction process is begun, the personal computer PC 
5 (CPU 100) converts the image data to a color coordinate system expressed by 
brightness and color difference, such as YCbCr or Lab. YCbCr is used in this 
example. The image data produced by a digital style camera 30 is most often 
YCbCr data, which requires no particular conversion process. On the other 
hand, when the data input to a personal computer PC is RGB data, RGB-YCbCr 
10 conversion is performed by the following calculations. 

[0043] 

Y = 0.2999 R + 0.587 G + 0.1 14 B 

Cr = 0.71 3 (R - Y) Cb = 0.564 (B - Y) 

[0044] The CPU 100 calculates the target pixel TP gradient (edge level) 
15 based on Y (brightness) and Cb and Cr (color difference) (step SI 00). Several 
procedures have already been established for calculating the edge level g. 
Examples used in this embodiment are the 3x3 Prewitt operators shown in 
Figure 4 and the 5x5 Prewitt operators shown In Figure 5. 

[0045] When the brightness of the target pixel TP is expressed as Y (ij), the 
20 CPU 100 calculates Afx and Afy using the following Equations (1) and (2). 
Equations (1) and (2) are examples of the use of the 3x3 Prewitt operators. 

[0046] 

4^=(r(/+ij-i)-r(/-i,7-i))+(y(/+i,7)-y(/-ij))+(^^^^ 

Equation(l) 

/S^=iYii-hJ-\)-Y(i-],j+l))HYiU-^)-YiU+l^^^^ 

Equation(2) 
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[0047] The CPU 100 then calculated the edge level g using the following 
Equation (3). 



[0048] 



g 



EquationO) 



5 [0049] The CPU 100 determines the edge level in the same manner as the Y 
component for the Cr and Cb components, respectively, and uses the greatest 
edge level g as the target pixel TP edge level. An example of the use of the 3 x 
3 Prewitt operators was used for convenience in the above embodiment, but 
nowadays when a greater number of pixels are used to form image data, the 
10 use of the 5x5 Prewitt operators is preferred for more accurately determining 
the edge level g. 

[0050] The CPU 100 determines whether or not the calculated edge level g is 
75 or higher (step S1 10). If it is 75 < g (step S1 10: Yes), then the edge angle G 
is calculated (step SI 20). The CPU 100 calculated the edge angle based on 



[0052] However, the angle 6 actually calculated by Equation (4) is the 
orientation 6 of the gradient relative to the horizontal direction as shown in 
20 Figure 1 , and is not, strictly speaking, the edge angle. However, because the 
orientation of the gradient is perpendicular (90°) to the orientation of the edge, 
the gradient orientation 9 and the edge orientation (edge angle) are uniquely 
related, allowing the edge angle to be determined by determining the gradient 
orientation 6. 

25 [0053] The CPU 100 obtains a median filter matching the edge angle on the 
image based on the calculated gradient orientation 6 (step SI 22). Median filters 



15 Equation (4) below using the previously determined Aftc and Afy. 



[0051] 




Equation(4) 
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MF oriented to reference areas RA (reference pixels focused on pixels 
surrounding the edge), as illustrated in Figures 6(a) through (h), are stored in 
the ROM 101 or HDD 102 of the personal computer PC. The CPU 100 selects a 
median filter MF matching the edge angle on the image, using the calculated 
5 gradient orientation 9 as an indicator. In this embodiment, median filters MF 
with 8 types of orientation in 2.25"* increments within the range from O** to 180° 
were prepared. 

[0054] In Figure 6, the black squares represent reference pixels, and the 
white pixels represent non-reference pixels, meaning skipped pixels which are 

10 not treated as target pixels (not smoothed). The angles in Figure 6 indicate the 
gradient orientation 9, not the orientation of the median filter MF (the actual 
angle formed on the image). That is, the gradient orientation 9 and the actual 
edge angle (orientation) are offset 90°, as noted earlier. In this example, 
gradient orientation 9 and the actual edge angle have been coordinated so as to 

15 enable the selection of a median filter MF matching the edge angle on the 

image using the gradient orientation 9 as an indicator in view of the differences 
noted above. 

[0055] Figure 6 depicts a median filter MF with a 9 x 9 angle for the sake of 
convenience, but the use of a 17 x 17 angled median filter MF will be preferred 
20 in actual processing. 

[0056] The CPU 100 executes a smoothing process using the median filter 
MF that has been obtained (step SI 24). The smoothing process is implemented 
only for the color difference components Cr and Cb, not the brightness 
component Y. In the example given, an image having the edge illustrated in 
25 Figure 1 has the pixel value (color and brightness) distribution illustrated in 
Figure 7. Because the target pixel TP gradient orientation 9 is 51°, the 45° 
median filter MF in Figure 6(b is selected to execute the median filter 
computation. 
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[0057] The target pixels in Figures 7 through 9 are represented by TP, TPn1, 
and TPn2. The reference pixels are the squares with the diagonal lines. The 
non-reference pixels are represented by the white squares. Although there are 
pixels between the squares, they are not shown, since they are skipped pixels 
5 which are not treated as either target pixels or non-reference pixels, in order to 
speed up the imaging process. 

[0058] Median values are calculated using the color difference or brightness 
of the reference pixels indicated by the diagonal lines and the brightness or 
color of the target pixel TP, giving the color difference of the target pixel TP after 

10 the noise reduction process (processed color value). The CPU 100 temporarily 
stores the processed color value obtained by these calculations in RAM 103. In 
this example, the target pixel TP had an initial color difference value of 255, and 
it was highly possible to indicate the noise with reference to the color difference 
or brightness of the surrounding pixels. When a conventional moving average 

15 filter is used, the color difference or brightness of all pixels within the borderline 
are referenced. As a result, the processed color value of the target pixel TP is 
111, and the edges are compromised by the noise reduction process. 

[0059] By contrast, in the noise reduction process of this embodiment which 
features the use of an angled median filter MF, a median value of 128 is 

20 obtained using the brightness or color difference of the reference pixels and the 
color value of the target pixel TP, allowing the noise to be reduced without 
compromising the edges. Because the smoothing process median filter 
computation) is managed by matching the reference area RA to the edge angle 
(edge orientation) so as to cover the edge-forming pixels, it is possible to 

25 implement a highly accurate noise reduction process that does not compromise 
edges while shortening the time for calculating the median filter, which normally 
takes a long time. 

[0060] A different example of a smoothing process using the angled median 
filters MF of this embodiment will be described for different target pixels TPnl 
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and TPn2 with reference to Figures 8 through 10. As illustrated in Figure 10, the 
gradient orientation 6 of the target pixel TPnl is Se"". The 45.0° median filter MF 
in Figure 6(b) is selected to implement the median filter computation. The 
processed pixel value (color difference) in this example is 128, whereas it would 
5 be 101 if a conventional moving average filter were used. The edges are thus 
not compromised in this example. As shown in Figure 10, the gradient 
orientation 9 of the target pixel TPn2 is eQ"", and the 67.5° median filter MF 
illustrated in Figure 6(c) would be selected to run the median filter computations. 
The processed pixel value (color difference) in this example is 96, whereas it 
10 would be 83 if a conventional moving average filter were used. The target pixel 
TPn2 is far lower than the surrounding pixel values and would be regarded as 
noise, but in this example, its color difference can be increased as an edge 
component, allowing the deterioration of the edge due to noise to be overcome. 

[0061] When the target pixel TP edge level g is less than 75 in step S1 10 
15 (step S1 10: No), the CPU 100 calculates the target pixel TP dispersion value for 
the brightness component Y and the color difference components Cb and Cr, 
using the greatest value as the dispersion value v for the target pixel TP (step 
SI 30). The dispersion value v is determined by the following Equation (5), 
where xi is either the Y. CB, or CR of the target pixel TP, and x bar is the 
20 average of all pixel values for each of Y, Cb, and Cr. 

[0062] 

In 

V = — ^ (x. — x) Equation(5) 

ni=i 

[0063] Because the expressed edge level g will sometimes be low regardless 
of the fact that the image contains edge components, the dispersion value v is 
25 calculated to execute a smoothing process suitable for the edge components 
contained in the edge. When the dispersion value v is high, it means that the 
image contains a relatively high edge component, and when the dispersion 
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value V is low, it means that the image does not contain a relatively large edge 
component. Accordingly, the smoothing process is implemented as follows 
using a moving average filter that is smaller as the dispersion value v increases. 

[0064] The CPU 100 determines whether or not the dispersion value v is 
5 greater than 200 (step S140). If the dispersion value v is determined to be 
greater than 200 (step S140: Yes), then the 9 x 9 moving average filter in 
Figure 9, that is, a moving average filter with reference pixels within a 9 x 9 
range, is used in the smoothing process on the target pixel TP (step 142). The 
CPU 100 temporarily stores the resulting processed color value in RAM 103. In 

10 this case, it means that fine components resembling the knitted weave of a 
sweater, for example, are contained around the target TP. As a result, a filter 
with a small reference area is used to lower the extent of smoothing so as to 
implement a smoothing process that does not compromise edge components 
such as knitting. In Figure 9 the black squares represent reference pixels, the 

15 white squares represent non-reference pixels, and the negative space indicates 
skipped pixels. The moving average filter used in this example should employ 
square pixels as reference pixels because it has a reference area 
corresponding to the Gauss distribution, but in order to shorten the calculation 
time, square pixels that do not significantly affect the smoothing process are 

20 used empirically as non-reference pixels. 

[0065] When the dispersion value v is 200 or less (step S140: No), the CPU 
100 determines whether or not the dispersion value v is greater than 50 (step 
SI 44). If the dispersion value v is determined to be greater than 50 (step S144: 
Yes), then CPU 100 implements a smoothing process on the target pixel TP 
25 using the 17 x 17 moving average filter in Figure 10 (step S146). The CPU 100 
temporarily stores the resulting processed color value in RAM 103. The black 
and white squares and negative space in Figure 10 mean the same as above. 

[0066] When the dispersion value v is determined to be 50 or less (step SI 44: 
No), the CPU 100 used the 21 x 21 moving average filter in Figure 1 1 to run the 
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smoothing process on the target pixel TP (step S148). The CPU 100 
tennporarily stores the resulting processed color value in RAM 103. In this case, 
it means that relatively uniform pixels representing space, for example, are 
contained around the target pixel TP. As a result, a filter with a large reference 
5 area is used to increase the extent of smoothing so as to implement a more 
powerful smoothing process that emphasizes noise reduction. The black and 
white squares and negative space in Figure 11 mean the same as above. 

[0067] When the CPU completes any of the above smoothing processes on 
the current target pixel TP. it determines whether or not the smoothing process 

10 has been completed for all pixels (except skipped pixels) (step SI 50). If it is 
determined that not all pixels (except skipped pixels) have completed the 
smoothing process (step SI 50: No), then the target TP is changed (step SI 60) 
and the process returns to step 100 to implement the above noise reduction 
processes on the next target pixel TP. If, on the other hand, it is determined that 

15 all pixels (except skipped pixels) have completed the smoothing process (step 
SI 50: Yes), the noise reduction process is complete. The CPU 100 applies the 
temporarily stored processed color values for the pixels to the corresponding 
pixels on the original image, converts the YCbCr data to RGB data, and then 
outputs the data to a data converter, such as a print driver, which converts the 

20 processed image data after any other image processes into a form suitable for 
an output device. The printer driver (CPU 100) converts the RGB data to CMYK 
data as befits the printer color space, runs any necessary processes such as 
half tone processing, then outputs the results in the form of raster data, for 
example, to a printer 20. 

25 [0068] As described above, according to the image processing apparatus in 
this embodiment, when an image contains edge components with a sizable 
edge level, the smoothing process is implemented using angled median filters 
MF having reference areas (smoothing areas) matching the orientation of the 
edges. When the image does not contain edge components with a sizable edge 
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level, the smoothing process can be implemented using moving average filters 
that are of sizes that differ according to the dispersion value v. It is thus possible 
to reduce or eliminate the noise in images without compromising the edges in 
the images (without smoothing the edges). 

5 [0069] More specifically, it is possible to execute a noise reduction process 
that preserves edges because the smoothing process (noise reduction process) 
involves the use of a median filter MF matching the orientation of the edge 
(edge angle) of the target pixel forming the distinct edge component. That is, 
the invention overcomes the problems of blurring and indistinctness associated 
10 with conventional noise reduction which involves the use of moving average 
filters. It is also possible to drastically reduce the computation time required in 
computing median filters, which has been another problem in the conventional 
use of median filters. It is thus possible to powerfully reduce or eliminate nose in 
images while preserving the edge components in images with edges. 

15 [0070] The smoothing process also employs moving average filter sizes 

according to the dispersion value v of the target pixel for target pixels which do 
not constitute distinct edges. The dispersion value v is a useful indicator for 
determining whether or not the target pixel constitutes an indistinct edge. A filter 
of a small size is used for target pixels forming indistinct edges to execute a 

20 smoothing process which does not compromise edge components, while a 

powerful smoothing process can be run by using filters of a large size for target 
pixels that do not form edges. It is thus possible to implement a smoothing 
process that is capable of more powerful noise reduction in parts that have no 
edge components without compromising the edges in an image compared to 

25 conventional smoothing processes in which moving average filters of different 
sizes are used according to image size. 

[0071] In this example, the Y, Cb, and Cr components were determined to 
calculate the edge level g and dispersion value v, and the greatest value was 
used as the edge level g and dispersion value v of the target pixel TP, but only 
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the color difference components Cb and Cr were the objects of the smoothing 
process. It is thus possible to eliminate or reduce color noise while preventing 
blurring associated with decreased brightness. 

[0072] 

5 Other Embodiments: 

The noise reduction process was done using a personal computer PC s 
the image processor, but it is also possible to use stand alone printers equipped 
with image processing functions as the image processor. In such cases, the 
noise reduction process is run by the printer. The process can also be run in the 
10 form of printer drivers or image processing applications (programs), without 
hardware structures such as image processing apparatuses. 

[0073] Prewitt operators were used to detect edges in the above example, but 
other operators such as Roberts operators and Sobel operators, as well as 
Laplacian filters or the like can be used to detect edges (detect edge levels). 

15 [0074] The color difference components Cb and Cr were the objects of the 
smoothing process in the above example, but a smoothing process can also be 
run on the brightness component Y, of course. 

[0075] The use of median filters with elliptical extraction areas was 
exemplified in the above examples, but the same effects can also be obtained 
20 with extraction areas that are wide in the direction parallel to. and narrow in the 
direction perpendicular to, the edge orientation. 

[0076] The image processing apparatus, noise reduction method, and noise 
reduction program of the invention were described in the above example, but 
the above embodiments were used only to illustrate the invention and do not in 
25 any way limit the invention. The invention is capable of various modifications 
and improvements within the sprit and scope of the invention, and the invention 
will also, of course, include their equivalents. 
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